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FIG. 2 



OBTAIN GEOMETRIC CALIBRATION DATA. 



i 



OBTAIN COLOR CALIBRATION DATA. 



i 

CAPTURE IMAGE OF WHITEBOARD HAVING 
PROJECTED ITEMS THEREON AND WRITING WRITTEN 
ON THE PHYSICAL WHITEBOARD. 



COMPUTE VISUAL ECHO. 



USE VISUAL ECHO CANCELLATION TO ISOLATE 
WRITINGS WRITTEN ON THE WHITEBOARD. 



SEND WRITING TO REMOTE PARTICIPANTS TO BE 
DISPLAYED AT A REMOTE DISPLAY IN CONJUNCTION 

WITH TRANSMITTED PRESENTATION AND 
ANNOTATIONS MADE BY REMOTE PARTICIPANTS AND/ 
OR ARCHIVED. 

y 

( END ) 



FIG. 3 



i 



PROJECT A SEQUENCE OF RECTANGULAR PATTERNS 

ONTO A WHITEBOARD AND SIMULTANEOUSLY 
CAPTURE SEQUENCE OF RECTANGULAR PATTERNS 
WITH A CAMERA. 



r 



DETECT THE CORNERS OF THE RECTANGULAR 
PATTERNS IN THE IMAGES CAPTURED WITH THE 

CAMERA. 



I 



USE THE CORRESPONDENCES BETWEEN THE 
LOCATIONS OF THE CORNERS IN THE IMAGES AND THE 
CORNERS ON THE WHITEBOARD TO ESTIMATE A 

HOMOGRAPHY H TO DEFINE THE GEOMETRIC 
RELATIONSHIP BETWEEN THE IMAGES AND THE 
WHITEBOARD. 



Q END ^ 



FIG. 4 



CONVERT COLOR IMAGES TO GRAYSCALE IMAGES. 



USE EDGE DETECTION TO DETECT EDGES OF 
RECTANGLES IN THE GRAYSCALE IMAGES THEREBY 
CREATING AN EDGE MAP. 

I 

USE A HOUGH TRANSFORM TO DETECT STRAIGHT 
LINES ON THE EDGE MAP. 



I 

FIT A QUANDRANGLE USING THE DETECTED STRAIGHT 

LINES. 



FIND CORNERS OF QUADRANGLE. 



t 

( END ) 

FIG. 5 



START 



QUANTIZE RGB COLOR SPACE INTO BINS. 



I 



r 



602 



PROJECT KNOWN COLOR C ON FULL SCREEN/ 
WHITEBOARD. 



604 



TAKE MULTIPLE (n FRAMES) IMAGES OF COLOR C ON 
SCREEN/WHITEBOARD WITH A CAMERA AND STORE. 



r 



606 



INCREMENT 
TO NEXT 
COLOR 



I 



WARP EACH IMAGE INTO SCREEN/WHITEBOARD 
COORDINATES USING HOMOGRAPHY H FOUND BY THE 
GEOMETRIC CALIBRATION. 



608 



1 — 616 



I 



CALCULATE THE MEAN AND VARIANCE OF EACH 
COLOR ACROSS N FRAMES WITHIN EACH SUB-REGION. 



610 



FILL IN THE ENTRIES IN THE LOOKUP TABLE FOR 
COLOR C WITH THE MEAN AND VARIANCE FOR EACH 

PIXEL. 



612 



614 




FIG. 6 



Q START ^ 



INPUT AN IMAGE OF THE WHITEBOARD. 



702 



I 



ESTIMATE THE VISUAL ECHO BY GEOMETRICALLY 
UNWARPING THE IMAGE AND SUBSTITUTING EACH 
PIXEL IN THE IMAGE WITH ITS CORRESPONDING MEAN 
COLOR FROM THE LOOKUP TABLE. 



704 



LOOK UP AND WARP THE VARIANCE FOR EACH PIXEL 
TO OBTAIN A PIXEL-WISE VARIANCE MAP. 



708 



( END ^ 



FIG. 7 



INPUT IMAGE OF A WHITEBOARD CONTAINING 
PROJECTED CONTENT, WRITINGS AND POSSIBLY 
ANNOTATIONSUSED TO CALCULATE THE VISUAL 

ECHO. 



r 



802 



COMPARE PROJECTED CONTENT WITH THE 
CORRECTED IMAGE (VISUAL ECHO) USING THE RATIO 
OF THE ALBEDO OF THE CAPTURED IMAGE TO 
ALBEDO OF VISUAL ECHO. 



r 



804 



USING ALBEDO RATIO DETECT WRITINGS ON 
WHITEBOARD (VERSUS PROJECTED CONTENT) AND 
RECOVER THEIR COLOR. 



806 



Q END ^ 



FIG. 8 
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